Papers with multi-agent system
LLM-Based Agent Society Investigation: Collaboration and Confrontation in Avalon Gameplay (2024.emnlp-main)
Copied to clipboard
Yihuai Lan, Zhiqiang Hu, Lei Wang, Yang Wang, Deheng Ye, Peilin Zhao, Ee-Peng Lim, Hui Xiong, Hao Wang
| Challenge: | Existing studies on LLM agents' social behaviors are lacking . previous studies focused on positive social behaviors, leaving research on negative social behaviors relatively scarce. |
| Approach: | They propose a framework that features a multi-agent system facilitating efficient communication and interaction with LLM agents. |
| Outcome: | The proposed framework is based on Avalon and evaluates on game success and analyzes agents’ social behaviors. |
Exploring Multi-Modal Data with Tool-Augmented LLM Agents for Precise Causal Discovery (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing statistical causal discovery methods rely on observational data and often overlook the semantic cues inherent in cause-and-effect relationships. |
| Approach: | They propose a multi-agent system powered by tool-augmented Large Language Models that can combine data from multiple modalities and integrate multi-modal data for knowledge-driven reasoning. |
| Outcome: | The proposed system has two agents: a Data Augmentation agent that retrieves and processes modality-augmented data, and a Causal Constraint agent that integrates multi-modal data for knowledge-driven reasoning. |
A Layered Debating Multi-Agent System for Similar Disease Diagnosis (2025.naacl-short)
Copied to clipboard
| Challenge: | Traditional classification, contrastive learning, and large language models fail to detect subtle clues necessary for differentiation. |
| Approach: | They propose a framework that leverages Large Language Models to achieve accurate disease diagnosis . they structure patient information and integrate extensive medical knowledge to guide the analysis . |
| Outcome: | The proposed framework aims to identify subtle differences between similar diseases . the proposed framework can be used in clinical practice to improve accuracy . |
Mitigating Judgment Preference Bias in Large Language Models through Group-Based Polling (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are used as automatic evaluators to provide accurate and reliable assessments. |
| Approach: | They propose a framework that integrates LLM-based judgment models into a multi-agent system and simulates the interactive client-server polling mechanism. |
| Outcome: | The proposed framework outperforms supervised models trained on annotated judgment data while requiring no human-labeled annotations. |
CrowdAgent: Multi-Agent Managed Multi-Source Annotation System (2025.emnlp-demos)
Copied to clipboard
Maosheng Qin, Renyu Zhu, Mingxuan Xia, null Chenchenkai, Zhen Zhu, Minmin Lin, Junbo Zhao, Lu Xu, Changjie Fan, Runze Wu, Haobo Wang
| Challenge: | Recent approaches to annotate data focus on labeling, but lack holistic process control . a novel system that integrates task assignment, data annotation, and quality/cost management is needed . |
| Approach: | They propose a multi-agent system that integrates task assignment, data annotation, and quality/cost management. |
| Outcome: | The proposed system automates human management by using a collaborative multi-agent system. |
AutoUE: Automated Generation of 3D Games in Unreal Engine via Multi-Agent Systems (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) and generative models have motivated studies on automated game generation from natural language descriptions. |
| Approach: | They propose a novel multi-agent system, AutoUE, which coordinates multiple agents to end-to-end generate 3D games, covering model retrieval, scene generation, gameplay and interaction code synthesis, and automated game testing for evaluation. |
| Outcome: | The proposed system covers model retrieval, scene generation, gameplay and interaction code synthesis, and automated game testing for evaluation. |
COAST: Enhancing the Code Debugging Ability of LLMs through Communicative Agent Based Data Synthesis (2025.findings-naacl)
Copied to clipboard
Weiqing Yang, Hanbin Wang, Zhenghao Liu, Xinze Li, Yukun Yan, Shuo Wang, Yu Gu, Minghe Yu, Zhiyuan Liu, Ge Yu
| Challenge: | Existing code debugging benchmarks focus on the Code Repair stage of the code generation process. |
| Approach: | They propose a framework to evaluate the debugging abilities of large language models by emulating the human debug process. |
| Outcome: | The proposed framework outperforms human-curated and GPT-4-generated training data, enabling 7B-scale LLMs to achieve comparable debugging performance to GPT-3.5. |
Smurfs: Multi-Agent System using Context-Efficient DFSDT for Tool Planning (2025.naacl-long)
Copied to clipboard
| Challenge: | Teaching large language models to use tools for solving complex problems can grant them human-like reasoning abilities. |
| Approach: | They propose a multi-agent system that enhances the Deep First Search Decision Tree (DFSDT) to address issues like error propagation and limited exploration in ReAct . |
| Outcome: | The proposed system reduces token usage by 60.9% compared to existing methods and performs on par with GPT-4-DFSDT. |
MindAgent: Emergent Gaming Interaction (2024.findings-naacl)
Copied to clipboard
Ran Gong, Qiuyuan Huang, Xiaojian Ma, Yusuke Noda, Zane Durante, Zilong Zheng, Demetri Terzopoulos, Li Fei-Fei, Jianfeng Gao, Hoi Vo
| Challenge: | Large foundation models (LFMs) can perform complex scheduling in a multi-agent system and can coordinate agents to complete complex tasks that require extensive collaboration. |
| Approach: | They propose a gaming-based infrastructure that evaluates LFMs' planning and coordination capabilities in the context of gaming interaction. |
| Outcome: | The proposed infrastructure can be deployed in a customized VR version of Cuisineworld and adapted in the “Minecraft” domain. |
Benchmark Self-Evolving: A Multi-Agent Framework for Dynamic LLM Evaluation (2025.coling-main)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models have demonstrated remarkable performance across tasks. |
| Approach: | They propose a benchmark self-evolving framework to dynamically evaluate rapidly advancing Large Language Models. |
| Outcome: | The proposed framework extends existing benchmarks to extend models across tasks and tasks. |
MultiAgentESC: A LLM-based Multi-Agent Collaboration Framework for Emotional Support Conversation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on generating responses directly and neglect integration of domain-specific reasoning and expert interaction. |
| Approach: | They propose a training-free multi-agent collaboration framework for ESC to emulate human-like process of providing emotional support through dialogue analysis, strategy deliberation, and response generation. |
| Outcome: | The proposed framework excels at providing emotional support and diversifying support strategy selection. |
Decoding Time Series with LLMs: A Multi-Agent Framework for Cross-Domain Annotation (2026.findings-eacl)
Copied to clipboard
Minhua Lin, Zhengzhang Chen, Yanchi Liu, Xujiang Zhao, Zongyu Wu, Junxiang Wang, Xiang Zhang, Suhang Wang, Haifeng Chen
| Challenge: | Time series data is ubiquitous across various domains, including manufacturing, finance, and healthcare. |
| Approach: | They propose a multi-agent system to generate general and domain-specific annotations for time series data. |
| Outcome: | The proposed system outperforms existing methods on synthetic and real-world datasets. |
Beyond Lines and Circles: Unveiling the Geometric Reasoning Gap in Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) demonstrate increasing proficiency in complex mathematical and algorithmic tasks, yet their geometric reasoning skills are underexplored. |
| Approach: | They propose a framework that enhances LLMs’ reasoning potential through a multi-agent system conducting internal dialogue. |
| Outcome: | The proposed framework enhances LLMs’ reasoning potential through a multi-agent system conducting internal dialogue. |
MADD: Multi-Agent Drug Discovery Orchestra (2025.findings-emnlp)
Copied to clipboard
Gleb Vitalevich Solovev, Alina Borisovna Zhidkovskaya, Anastasia Orlova, Nina Gubina, Anastasia Vepreva, Rodion Golovinskii, Ilya Tonkii, Ivan Dubrovsky, Ivan Gurev, Dmitry Gilemkhanov, Denis Chistiakov, Timur A. Aliev, Ivan Poddiakov, Galina Zubkova, Ekaterina V. Skorb, Vladimir Vinogradov, Alexander Boukhanovsky, Nikolay Nikitin, Andrei Dmitrenko, Anna Kalyuzhnaya, Andrey Savchenko
| Challenge: | Recent advances in artificial intelligence have limited access to wet-lab tools for hit identification . multi-agent systems combine interpretability of LLMs with precision of specialized models and tools . |
| Approach: | They propose a multi-agent system that builds and executes customized hit identification pipelines from natural language queries. |
| Outcome: | The proposed system reduces the complexity of traditional screening methods and improves efficiency. |
Cogito: A Cognitive Agentic Framework Driven by Dynamic Graph of Thoughts for Financial Report Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to financial report generation are insufficient to handle dynamic uncertainties of real-world financial environments. |
| Approach: | They propose a cognitively grounded agentic framework for professional financial report generation that is driven by Dynamic Graph of Thoughts and a social collaboration mechanism to facilitate coordinated agent interaction. |
| Outcome: | The proposed framework is based on a dynamic reasoning model and social collaboration mechanism. |
Can an Individual Manipulate the Collective Decisions of Multi-Agents? (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies show that coordinated multi-agent systems exhibit enhanced decision-making and reasoning abilities through collaboration. |
| Approach: | They propose a framework that simulates agent interactions within a multi-agent system to generate adversarial samples and use them to manipulate the target agent in the target system. |
| Outcome: | The proposed framework generates adversarial samples that are used to manipulate the target agent in the target system, misleading the system’s decision-making process. |
Closing the Spatial Execution Gap in Digital Whiteboards via Verifiable Reinforcement Learning (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models suffer from a fundamental Spatial Execution Gap, failing to translate visual semantics into precise, schema-valid coordinate operations in interactive environments. |
| Approach: | They propose a pipeline that leverages Group Relative Policy Optimization to enforce a strict Identify-Reason-Verify protocol and train on execution-verifiable rewards. |
| Outcome: | The proposed pipeline outperforms a state-of-the-art frontier model by 16.75% in operation accuracy. |
TeamFusion: Supporting Open-ended Teamwork with Multi-Agent Systems (2026.acl-long)
Copied to clipboard
| Challenge: | Many group decisions are open-ended, and aggregation approaches suppress minority perspectives . team members must surface hidden assumptions, discuss disagreements, negotiate acceptable trade-offs . |
| Approach: | They propose a multi-agent system that instantiates a proxy agent for each team member . they also conduct a structured discussion to elicit agreements and disagreements . |
| Outcome: | The proposed system outperforms direct aggregation on two teamwork tasks . it can judge how well individual views are represented in team decisions and consensually good deliverables . |
QuantAgents: Towards Multi-agent Financial System via Simulated Trading (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing LLM-based agent models exhibit significant deviations from real-world fund companies. |
| Approach: | They propose a multi-agent financial system that incorporates simulated trading . they propose simulated trades are evaluated without assuming actual risks . |
| Outcome: | The proposed system evaluates various investment strategies without assuming actual risks without involving real-world investors. |
Reflections & Resonance: Two-Agent Partnership for Advancing LLM-based Story Annotation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for story annotation require a meticulous and resourceintensive effort, but the advent of advanced computational tools like GPT-4 can streamline the process and mitigate common limitations. |
| Approach: | They propose a multi-agent system that generates tailored prompts for a large language model and provides feedback to refine the initial prompts. |
| Outcome: | The proposed system significantly improves the model's reconstruction accuracy and confidence, demonstrating that dynamic interaction between agents significantly boosts the annotation process's precision and efficiency. |
DICE-BENCH: Evaluating the Tool-Use Capabilities of Large Language Models in Multi-Round, Multi-Party Dialogues (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing function-calling benchmarks focus on single-turn interactions but ignore complexity of real-world scenarios. |
| Approach: | They propose a framework that constructs practical function-calling datasets by synthesizing conversations through a tool graph that maintains dependencies across rounds. |
| Outcome: | The proposed framework synthesizes conversations through a tool graph that maintains dependencies across rounds and a multi-agent system with distinct personas to enhance dialogue naturalness. |
Learning to Evolve: A Self-Improving Framework for Multi-Agent Systems via Textual Parameter Graph Optimization (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for designing and optimizing multi-agent systems are static and do not learn from experience. |
| Approach: | They propose a framework that enables a multi-agent system to learn to evolve . they use "textual gradients" to pinpoint failures and suggest granular modifications . |
| Outcome: | a new framework enables a multi-agent system to learn to evolve . it learns from historical optimization experiences to improve its performance . |
MTR-Suite: A Framework for Evaluating and Synthesizing Conversational Retrieval Benchmarks (2026.acl-long)
Copied to clipboard
Junhao Ruan, Abudukeyumu Abudula, Bei Li, Yongjing Yin, Xinyu Liu, Kechen Jiao, Xin Chen, Jingang Wang, Xunliang Cai, Tong Xiao, JingBo Zhu
| Challenge: | Existing conversational retrieval benchmarks suffer from costly, sparse human annotation or rigid, unnatural automated heuristics. |
| Approach: | They propose a framework for auditing, synthesizing, and benchmarking conversational retrieval. |
| Outcome: | The proposed framework is based on three LLM-based auditors and a multi-agent system . it mimics production-style challenges (hard topic switching, verbosity) and offers superior discriminative power. |
LegalGraphRAG: Multi-Agent Graph Retrieval-Augmented Generation for Reliable Legal Reasoning (2026.acl-long)
Copied to clipboard
Zerui Chen, Qinggang Zhang, Zhishang Xiang, Zhimin Wei, Linfeng Gao, Xiao Huang, Zhihong Zhang, Jinsong Su
| Challenge: | Graph-based Retrieval-Augmented Generation (GraphRAG) is a new approach to document retrieval, but it is not suitable for legal reasoning. |
| Approach: | They propose a framework for reliable legal reasoning that structures knowledge as relational graphs and uses a multi-agent system to verify validity. |
| Outcome: | The proposed framework outperforms existing GraphRAG models in accurate and trustworthy legal analysis. |
LongVideoAgent: Multi-Agent Reasoning with Long Videos (2026.acl-long)
Copied to clipboard
| Challenge: | a key emerging challenge is robust long video understanding, authors say . current methods compress content into lossy summaries or rely on limited toolsets . |
| Approach: | They propose a multi-agent framework where a master LLM coordinates a grounding agent and a vision agent to extract targeted textual observations. |
| Outcome: | The proposed model outperforms strong non-agent baselines on episode-level datasets . the proposed model significantly outperformed existing models on other datasets. |
Human-Agent Collaborative Paper-to-Page Crafting (2026.findings-acl)
Copied to clipboard
Qianli Ma, Siyu Wang, Chen Yilin, Yinhao Tang, Yixiang Yang, Chang Guo, Bingjie Gao, Zhening Xing, Yanan Sun, Zhipeng Zhang
| Challenge: | Existing approaches to create project pages from academic papers have focused on static slides and posters, but the dynamic nature of webpages remains an unaddressed challenge. |
| Approach: | They propose a novel multi-agent system that deconstructs paper-to-page creation into a coarse-to fine pipeline from narrative planning to multimodal content generation and interactive rendering. |
| Outcome: | The proposed system generates high-quality, visually appealing pages in under 15 minutes for less than $0.1 . |
ReTRE: Benchmarking LLM Transfer Robustness with Structure-Preserving Variants (2026.acl-long)
Copied to clipboard
| Challenge: | Learning transfer theory emphasizes that applying acquired knowledge to novel manifestations is a key signal of deep understanding |
| Approach: | They propose a benchmark that probes transfer robustness along two rewrite levels: Near Transfer and Far Transfer. |
| Outcome: | The proposed benchmark demonstrates that large language models are robust when faced with novel manifestations of the same problem. |
PolitNuggets: Benchmarking Agentic Discovery of Long-Tail Political Facts (2026.acl-long)
Copied to clipboard
| Challenge: | Large Reasoning Models (LRMs) are embedded in agentic frameworks and are under-evaluated. |
| Approach: | They propose a multilingual benchmark for agentic information synthesis using PolitNuggets . they standardize evaluation with an optimized Supervisor–Searcher multi-agent system . |
| Outcome: | The proposed model can discover and synthesize "long-tail" facts from dispersed sources. |
AutoAgent: A Fully-Automated and Zero-Code Framework for LLM Agents (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Model (LLM) agents have demonstrated remarkable capabilities in task automation and intelligent decision-making. |
| Approach: | They propose a Fully-Automated and highly Self-Developing framework that enables users to create and deploy LLM agents using natural language alone. |
| Outcome: | AutoAgent is a fully-automated and highly self-developing framework that enables users to create and deploy LLM agents using natural language alone. |